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EFFICIENT SERVICE MANAGEMENT 
IN HOME GATEWAYS 

Background of the invention 

[0001] The present invention relates generally to home gateways, and 
more particularly, to an efficient method for managing application services in a 
limited memory environment, such as a home gateway. 

[0002] With the widespread introduction of broadband to homes, the 
Internet is becoming more and more popular inside homes. The Internet is used 
not only for connecting computing devices, but also for accessing home 
appliances, spch as TVs, DVDs, washing machines, etc. In the near future, it is 
expected that many home appliances will be connected to the Internet. Remote 
diagnosis and configuration of these appliances is one of the many advantages 
that the consumer can gain from Internet connectivity. Power companies are 
also keeping an eye on home networking because it will allow them to provide 
value-added services such as energy management, remote measurement, and 
better power balance that reduces the likelihood of blackout. 

[0003] There are several initiatives to define a specification and 
protocol for networks residing in the home environment, including OSGi, HAVi, 
UPnP, Jini, and HomeRF, to name a few. It is expected that such home 
networking will inter-operate through a home gateway. The home gateway 
serves as a single point of connection between the Internet and the home. 

1 



Services are implemented in software bundles that can be downloaded 
separately from the Internet and then executed in the gateway. 

[0004] There is not consensus among the industry on whether the 
home gateway will be integrated into existing home appliances, distributed 
among several home appliances, or centralized in a separate computing device. 
In either case, the home gateway will more than likely have limited resources, 
especially main memory. 

[0005] Conventional memory management techniques are not 
necessarily suitable for home gateways. For instance, the memory unit in a 
conventional computing environment is the disk page. Conventional memory 
management techniques typically assume that disk pages are independent. 

[0006] In contrast, the services in a home gateway may not be 
independent, but rather can depend from each other. In other words, terminating 
a service will in effect terminate all of the services that depend on that service. 
Because of service dependencies, traditional memory management techniques 
are not suitable to the gateway environment. 

[0007] Therefore, it is desirable to provide an efficient method for 
managing application services in a limited memory environment, such as a home 
gateway. 



Summary of the Invention 

[0008] In accordance with the present invention, a method is provided 
for managing memory resources in a service gateway environment. The method 
includes: receiving a service request, the service request having an associated 
memory space requirement that exceeds total available memory space 
associated with the gateway environment; determining a number of dependent 
service instances for each service instance; determining an accumulative 
memory space requirement for each service instance; identifying a subset of 
service instance whose memory space requirement exceeds the memory space 
requirement of the service request, the subset having a minimal number of the 
service instances; and performing a memory resource management operation in 
relation to the identified subset of service instances. 

[0009] For a more complete understanding of the invention, its objects 
and advantages, reference may be had to the following specification and to the 
accompanying drawings. 

Brief Description of the Drawings 

[0010] Figure 1 is a block diagram depicting a software architecture of 
an exemplary service gateway in accordance with the OSGi model; 

[0011] Figure 2 is a diagram illustrating the memory resource problem 
of the present invention; 



[0012] Figure 3 is a flow chart depicting a method for managing 
memory resources in a service gateway environment in accordance with the 
present invention; 

[0013] Figure 4 is a flowchart depicting an alternative method for 
managing memory resources in a service gateway environment in accordance 
with the present invention; 

[0014] Figure 5 is a diagram illustrating a post-order traversal of a 
plurality of service instances in accordance with the present invention; and 

[0015] Figure 6 is a diagram illustrating an exemplary dynamic 
programming table in accordance with the present invention. 

Detailed Description of the Preferred Embodiments 
[0016] Figure 1 illustrates the software architecture of an exemplary 
service gateway in accordance with the OSGi model. OSGi specification defines 
common implementation APIs that are suitable for service gateways in a variety 
of different applications. While the following description is provided with 
reference to this particular software architecture from the OSGi model, it is 
readily understood that the broader aspects of the present invention encompass 
other software architectures as well as other known gateway specifications. 

[0017] In a service gateway environment, applications are designed as 
a set of services, with each service implementing a segment of the overall 
functionality. These services and other extension services are then packaged 
into a software container called a bundle. The gateway can download the 



corresponding bundle when it becomes necessary. The framework handles 
basic bundle management functionality. In order to share its services with other 
bundles, a bundle can register any number of services with the framework. The 
execution thread of a bundle in the framework is referred to as a service 
instance. 

[0018] To accommodate a new service, the gateway might need to free 
memory space associated with the gateway. Although the amount of memory 
required to execute a service is changing with time, the application service 
provider (or the author who provides the bundle) can give approximate estimates 
such as average and maximum amount of memory required to execute the 
services in a bundle. At this time, the framework has to pick a victim service 
instance or instances to terminate in order to fulfill the request. It is envisioned 
that the victim service instance might be the requesting service. 

[0019] This memory resource problem is further illustrated by the 
example set forth in Figure 2. Two exemplary applications are executing in a 
service gateway environment. The first application is an audio-on demand 
service 20 which has a memory requirement of 30 memory units. The audio-on- 
demand service 20 depends on an audio player service 22 which in turn depends 
on a UDP service 24. The audio player service 22 and the UDP service 24 have 
a memory requirement of 50 and 25 memory units, respectively. The audio-on- 
demand service 20 also* depends on an equalizer service 26 which has a 
memory requirement of 105 memory units. The second application is a Internet 
game 27 which has a memory requirement of 65 memory units. The Internet 



game service 27 depends on an HTTP service 28 which has a memory 
requirement of 45 memory units. 

[0020] A request is made for a third service. The third service is a 
home security 29 service which requires 100 memory units. Assume that the 
memory space requirement for the home security service exceeds the total 
available memory space associated with the gateway environment. Lets further 
assume that the home security service has a higher priority than the audio-on- 
O demand service and the game service. Therefore, at least one of the services 

SI must be terminated to meet this request. In this example, the equalizer service 

f} 26 should be terminated because it fulfills the memory space requirement and 

minimizes the number of service instances that are terminated. 

* 

ii [0021] A formal description of the problem is set forth below. The set 

yj of service instances currently resident in gateway memory may be defined as 

W S = {$,,..., s y }. A dependence graph may be used to model the dependencies 

among bundles, where one bundle imports a service provided by another bundle. 
For example, let G(S,E), be a directed acyclic graph with vertex set S and edge 
set E, describing the dependence among the service instances. There is a 
directed edge (s i9 s s )e E if and only if s\ depends on Sj. Since it is natural to 

assume that each application instantiates its own copy of a given service, the 
dependence graph will consist of a forest of rooted trees, where each tree 
represents the service instances instantiated by a given application. For a vertex 
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v in G, let us denote by T(v) the set of vertices of the sub-tree of G rooted at v 
(including v itself), and for a subset of vertices V qS, let T(V) := U veV T(v). 

[0022] Given that a new service instance s, with a memory space 
requirement MO), is to be created, it might be required to terminate some 
existing service instances in order to make room for the new instance. Assume 
that the additional memory required for this operation is M t units, where 

M t =M(s)-M f1 and M/\s the current amount of available memory space. 

When a service instance is terminated, all instances depending on it will also be 
terminated. Therefore, the objective is to reduce the number of terminated 
service instances. More precisely, it is desired to find a subset V c S of minimal 
number of dependants, whose termination, together with all its dependants, will 
make available a total memory space of at least Mt units. Letting 
M(S):=£ se5 ,M(>) for any S'cS, the problem can be formulated as of finding 

min{|r(V)|:V a S,M(T(V))> M { }. In other words, the problem is to identify a 

minimal number of service instances whose memory space requirement exceeds 
the memory space requirement of a service request. 

[0023] Referring to Figure 3, a method is provided for managing 
memory resources in a limited memory environment, where the at least some of 
the service instances are dependent on other service instances. This method 
provides one preferred solution to the problem set forth above. Upon receipt of a 
service request, the method is initiated at step 32, where the service request has 
a memory space requirement that exceeds the total available memory space 



associated with the gateway environment. In order to satisfy the service request, 
the method identifies one or more service instance(s) that are to be terminated 
from the environment. 

[0024] First, an accumulative memory space requirement, M(s*), is 

determined at step 34 for each service instance resident in the gateway 
environment. The accumulative memory space requirement for a given service 
instance accounts for the memory requirement for the given service instance and 
each of the service instances depending from it. Thus, accumulative memory 
space is computed by summing the memory space requirements for the given 
service instance with the memory space requirement for each of the service 
instance that depend from it. 

[0025] Second, the number of dependent service instances, s*, is 
determined at step 36 for each service instance. In an exemplary embodiment, 
may be retrieved from a data store associated with the environment. The data 
store generally maintains dependency information for each of the service 
instances currently resident in the gateway environment. For each service 
instance, the data store may include an identifier for a given service instance, the 
accumulative memory space requirement for the given service instance, and the 
number of service instances that depend from the given service instance. 
Although presently preferred, it is envisioned that other techniques may be 
employed for determining the accumulative memory space requirement and 
number of dependencies for each service instance. 
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[0026] Third, a ratio is computed for each service instance at step 38. 
The ratio is further defined as the accumulative memory space requirement for a 
given service instance divided by the number of dependent service instances for 
the given service instance. Maximizing this ratio tends to decrease the number 
of terminated service instances. 

[0027] Lastly, a memory resource operation is then performed at step 
39 in relation to the service instance having the largest ratio. Specifically, the 
service instance having the largest ratio and each of the services instances that 
depend from it are terminated. If two service instances have the same ratio, then 
the service instance having the fewest dependencies is selected for termination. 
One skilled in the art will readily recognize that the data store that maintains 
dependency information for each of the service instances is updated to account 
for the terminated service instances. 

[0028] In some instance, the accumulative memory space requirement 
for the terminated service instance (and its dependents) may not exceed the 
requested memory space. In this case, the above-described process is 
repeated, thereby terminating additional service instances. On the other hand, 
once the total available memory space is equal to or exceeds the memory space 
requirement of the service request, the service request is satisfied. 

[0029] There is also a natural generalization of problem set forth 
above. Suppose that different service instances differ in importance and, 
therefore, are assigned different priorities. In such a case, it is reasonable to 
assign a weight W(s) to each instance. Instances with large weights are 



considered more important. When it is necessary to eject some instances from 
memory, it is desirable to reduce the number of deleted high priority instances. 
Thus, the problem now becomes of finding rmn{W(T(V))/V c S 9 M(T(V)) >M t }. 

[0030] In the absence of dependencies, this problem is closely related 
to the well-known Knapsack problem. The Knapsack problem admits a pseudo 
polynomial algorithm which runs in 0(n 2 W), where W is the maximum weight. 
Even in the case of dependencies among service instances, a similar result holds 
for this problem as shown below, 

[0031] In view of the foregoing, an alternative method is presented for 
managing memory resources in a limited memory environment, such as a service 
gateway. Referring to Figure 4, the method is initiated at step 42 upon receipt of 
a service request. In order to satisfy the service request, the method identifies 
one or more service instance(s) that are to be deleted from the environment. 
The technique generally uses dynamic programming. 

[0032] An accumulative memory space requirement, M(s*), is first 
determined at step 44 for each service instance resident in the gateway 
environment. Next, an order is determined at step 46 for traversing the service 
instances in the gateway environment. The service instances are preferably 
traversed recursively in a post-order. Specifically, let S = S n = {s 19 ... 9 s H ] be the 

current set of service instances listed in post-order traversal (that is, recursively 
traverse the children from left to right then traverse the root). Consider 
incrementally the sets S x ={s { },S 2 ={s l9 s 2 } 9 S 2 = {s l9 s 29 s 3 },... 9 computing for each 
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set the maximum amount of memory that can be achieved by deleting a subset 
of service instances at given number of dependents. In order to compute these 
maxima, compute for each node s t , the largest index ke {l,...,z-l} such that s k 

is not a descendant of s r Let L(s t ) denote such an index. The procedure gives 

the post-order traversal of a given forest and computes the required indices L(s t ) 

for each i = l,...,n, 

[0033] For instance, an exemplary procedure for post-order traversal of 
a given subtree of the dependence forest G rooted at v and an integer k, is as 
follows: 

1. If |T(v)j=0 // tree is empty 

return. 

2. If |T(v)|=1 //vis a leaf node 

L(v) <- k. 

3. else for each child u of v: 

traverse (u,G,k); 

4. L(v) ^L(leftmost(v)); 

5. k<-k+1; 

6. s k «-v. 

This procedure yields the post order-traversal traversal {^,5 w ,.,.,5| T(v) | +w ) of 

T(v), and the set of indices {L(s)|se T(v)}, 

[0034] If the connected components of the forest G are Ci, C2, C r , 
then in order to compute the post-order traversal for G, the above procedure is 
called r times: 

1. Find the connected components C1, C2, ..,C r of G. 

2. k^O. 

3. Fori=1«tor 

traverse(root(Cj), G, k). 
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Thus, this procedure yields the post-order traversal {s ly s 2 ,...,s n } of G, and the 
set of indices {L(j)|j€ V(G)}. This procedure is illustrated briefly in Figure 5. 

However, it is envisioned that other traversal orders are also with the scope of 
the present invention. 

[0035] Returning to Figure 4, a dynamic programming table is then built 
at step 48, such that the entries in the table indicate an amount of memory space 
that can be attained by deleting a subset of the service instances. In what 
follows, nodes u,veV(G), will be said to be incomparable if neither is a 
descendant of the other, i.e., v^T(u) and ugT(v). Note that n is a trivial upper 
bound on the total number of instances (or weight) that can be achieved by any 
solution. For each i E{1,...,n} and each w e{1,...,n}, let S iw denote a subset, of 

incomparable elements of S t ={s l9 ... 9 s t ], whose total weight is exactly w, and 
whose total memory is maximized. Let A(/,w) = M(T(S l J) if the set s iM exists, 
and A(i,w) = -oo otherwise: 



A(z\w) = 



- oo if there is no set S c S. of incomparable elements such that |r(5)]= w, 

0 ifi = 0orw = Q 9 
max (T(S)) S QS t ,|jT(S)|= w, elements of S are incomparable^ otherwise. 



[0036] The dynamic programming table is constructed such that each 
row of the table correlates to a subset of service instances in accordance with the 
post-order and each column correlates to a number of service instances that are 
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to be deleted from the subset. Specifically, A(1,w) is known for every we 
{1 ,...,n}; whereas the other values of A(i,w) can be computed incrementally using 
the following recurrence: 

A(i>l,w) = max{A(^ )}, if \T(s l+l )\<w and 

A(i + l,w) = A(i,w) otherwise. As a result, each entry in the table indicates a 
maximum amount of memory space that can be attained by deleting the 
corresponding number of service instances from the corresponding subset of 
service instances. An exemplary dynamic programming table is shown in Figure 
6. 

[0037] Lastly, one or more service instances are identified using the 
dynamic programming table at step 50. In particular, the service instances are 
identified by evaluating from left to right the bottom row of the table. The first 
table entry whose value (i.e., memory space) exceeds the memory space of the 
service request is selected, where the table entry correlates to a subset of 
service instances that to the deleted. The corresponding subset of service 
instances are then deleted at step 52, thereby fulfilling the service request. 

A more formal description of this alternative algorithm is as follows: 

1 . For each node seS, compute the accumulative size and memory: 

c(s) «- |T(s)| and m(s) <- M(T(s)). 

2. Call Traverse- forest (G) to get the post-order traversal {^,$2 ,...,$„} of 

G, and the set of indices {L(s) j s e V (G)}. 

3. Initialize: 

A(i,0) =0 for all i=1,...,n, 
A(0,w) =0 for all w=1,...,n, 
A(1 ,1) =m(5,), and A(1 ,w) = -<*> for all w=2,...,n. 
// build dynamic programming table 

4. For i=1 to n 
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5. For w=1 to n 

if c(s, +l )<w 

if A(i, w) > m(s M ) + A(L(s [+1 ), w - c{s , +1 )) 

A(i+1,w) <r- A(i,w); 
B(i+1 ,w) <-0 
else 

A(i + 1, w) <- ) + A(L(5 i+1 ), w - c(.s i+1 )); 

B(i+1 ,w) <-1 
else 

A(i+1 ,w) <-A(i,w); 
B(i+1 ,w) «-0. 
// compute optimal solution 

6. Sf- 0; i <r- n; k min{we[n] : A(i,w) > Mt}. 

7. While i>0 

8. if B(i, k)=1 

S^SU {sj; i ^ L(Si); k <- k - c(Sj). 
else 

i«-i-1. 

9. For each seS, delete T(s). 

As will be apparent to one skilled in the art, an O (n 2 ) time and O (n 2 ) space is 
required for solving this problem in accordance with this alternative algorithm. 

[0038] The foregoing discloses and describes merely exemplary 
embodiments of the present invention. One skilled in the art will readily 
recognize from such discussion, and from accompanying drawings and claims, 
that various changes, modifications, and variations can be made therein without 
departing from the spirit and scope of the present invention. 



